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Motivation 


The  Big  Quest 

Teasing  out  “function”  of  Primary  Auditory  Cortex  (AI) 

which  sounds/features  evoke  responses? 
how  are  they  encoded  into  spike  trains? 


function 


{i 


•  Broadband  and  dynamic  sounds 

•  Evoke  strong,  sustained,  dynamic  responses  in  AI 

•  Many  natural  sounds 

e.g.  speech,  vocalizations,  backgrounds 


•  Reasonable  quest 

Quantitative  measure  of  how  spikes  encode  sound  features 

•  Quantitative  descriptor 

•  Quantitative  predictor 

•  Visual  tool — a  la  Spectral  Response  Field/Tuning  Curve 


•  Compromise  from  quantitative  necessity 

•  Restrict  broadband  and  dynamic  sounds  to  mathematically 

simple  subset: 

•  Noise — strongly  modulated  in  spectrum  and  time 

•  not  a  severe  compromise 


Spectro-Temporal  Receptive  Field  (STRF)  meets 
criteria: 
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Quantitative  descriptor 
Quantitative  predictor 
Visual  Tool 


\> 

Center  for  Auditory 
and  Acoustic  Research 


institute  for  Systems  Research 
University  of  Maryland 


Sound  Features 


•  Spectro-Temporal  Features  of  Any  Sound 

•  Spectral  content  of  sound  as  a  function  of  time. 


Which  spectral  frequency  bands  have  enhanced  power? 
Which  spectral  frequency  bands  have  diminished  power? 
How  do  these  change  as  a  function  of  time? 


“water  all  year” 


Characterization  from  cross-section  is  limited 


\> 

Center  for  Auditory 
and  Acoustic  Research 


institute  for  Systems  Research 
University  of  Maryland 


Stimulus  Construction 

Pink  Noise  =  flat  power  density  in  octaves  [log  (/)] 

not  white 


Unmodulated  noise  (flat) 

Power 
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Spectrally  modulated  noise 
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Spectro-Temporally  modulated  noise 
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=  log/ 


Spectro-Temporal  Response  Field  (STRF)  ^ 


•  Spectro-temporal  response  field  of  neuron  is  the  standard 
response  field,  made  time-dependent. 


•  Frequencies  mapped  along  cochlea  on  log  frequency  axis 

A 

Spectro-Temporal 
Response  Function 
(STRF) 
of  a  neuron 
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Interpreting  STRFs 


Stimulus  Effect  on  Rate 


STRF  region 

Stimulus  Power 

Spike  rate  contribution 

Excitatory  • 

Enhanced  • 

Faster  r.  X  -i  -t  X 

Inhibitory  # 

Enhanced  • 

Slower  X  X 

Excitatory  # 

Diminished  # 

Slower  X  X 

Inhibitory  # 

Diminished  # 

Faster  (!)X  XXXX 

Cross-section  interpretations 


Rate 


Rate 
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^  Spectro-Temporal  Response  Field  (STRF)  ^ 

&  its  Transfer  Function 


2  Dimensional  Fourier  Transform 


•  Its  Fourier  transform  is 
the  transfer  function. 

•  Analysis  is  often 
conceptually  simpler 
in  the  Fourier  domain. 

•  Either  can  be  used  to 
predict  the  linear 
response  to  any 
broadband  dynamic 
sound. 


2  Dimensional 
Transfer  Function 
of  the  same 
neuron 


ripple  velocity  (Hz) 
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Single  Moving  Ripple 


Single  Ripple  in 
Spectro-Temporal  Space 
{Spectrogram) 


Ripples  are  auditory  “gratings” 
whose  spectral  envelope  is  a 
sinusoid  along  the  log(/)  axis.  At 
any  time  t  and  any  frequency  v, 
the  amplitude 
S{t^)  is  given  by: 

S{t,x)=  sin[27twt  +  2%Qjc  +  (|)] 


•*  =  log2[f//o] 

w  =  ripple  velocity, 

e.g.  4  Hz  =  4  cycles/s 
n  =  ripple  density, 

e.g.  0.4  cycles/octave 
=  2  cycles/5  octaves 
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Single  Ripple  in 
Fourier  Space 

0.4  cyc/ocT 


-A  Hz 


4  Hz  VP 


-0.4  cyc/oct 


The  Fourier  transform 
of  a  single  moving 
sinusoid  has  support 
only  on  a  single  point 
(and  its  complex 
conjugate). 
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Multiple  Individual  Ripples 


Sit,x)=  sm\2%wt  +  InOx  +  (])]  w  =  ripple  velocity 

X  =  log^lf/fo]  ^  =  ripple  density 
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The  Fourier  space  of  the 
spectrograms.  We  probe  a  cell  at 
different  velocities  w  and  different 
densities  Q. ,  and  quantify  the 
response  for  up  and  down-moving 
sounds. 

Any  ripple  in  the  lower  half-plane 
is  equivalent  to  a  ripple  in  the 
upper-half  plane. 
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Spike  Train  Measurements 


A 


Ripple  Frequency  (cyc/oct)  Ripple  Velocity  is  8  Hz 


0  170  340  510  680 
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Ripple  Frequency  (cyc/oct) 


Spike  events  in  (A)  are  turned  into  period 
histograms  in  (B).  The  amplitudes  and 
phases  give  the  transfer  function  in  (C), 
which  can  be  inverse  Fourier  transformed 
to  give  Response  Fields  in  (D). 
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Spectro-Temporal  Noise 

To  speed  up  the  characterization  of  a  cell’s  response,  we  use 
combinations  of  ripples  of  all  velocities  w  and  densities  Q.,  with 
random  phases. 
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Spectro-T  emporal 
generalization  of 
white  noise 
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Cross-Correlation:  C(t,  x)  =  ^  x)7?(t-T)dt  =  ^V5(4-T,  x) 

k  .  . 

•  C(t,  x)  contains  cross  terms  “ 

•  Cross  terms  have  random  phase  and  can  be  attenuated 
by  averaging  over  multiple,  random-phase  stimuli. 

Sj(t,x)  R(t)  C/-T,x)  .  ^ 

STRF”rtx,  x)  =  ^  X  C,(-X,  X) 
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'  Temporally  Orthogonal  Ripple  '  j 
Combinations  (TORCs) 

To  eliminate  interference  from  cross-terms,  we  use  specific 
combinations  of  ripples  with  differing  velocities  w  and  random  phases. 


•  Stimuli  are  composed  only  of  ripples  with  different  ripple  velocities. 

•  Each  stimulus  contains  ripples  which  cover  the  same  range  of  ripple 
velocities,  but  at  different  ripple  frequencies. 

•  Multiple  stimuli  are  still  needed  to  present  a  complete  set  of  ripples. 


5T0RC(^^^)  =^.  sin[27rw/  +  2%Q.]pc  +  (|)y  J 


TORCs  are  better  suited  for 
temporal  cross-correlation 
because  there  are  no  cross 
terms.  The  resulting 
estimates  are  robust,  use 
short-duration  stimuli,  and 
are  quickly  computed. 
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STRFs  Compared  ‘ 


0  t  (ms)  250 
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STRF  from  Spectro- 
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225/37d  225/30a  226/2 la 


Separability 


,  Fully  Separable  STRF 

=  ^ogf/fo  ^  ■ 


The  STRF  and  TF  are  a 
product  of  a  single  spectral 
response  function  with  a 
single  temporal  response 
function. 


Shown  above  are  the  impulse  responses  (IR)  and  receptive  fields  (RF) 
derived  from  quadrant  1  (black)  and  quadrant  2  (red)  of  the  transfer 
function  by  inverse  Fourier  transformation. 


X  =  log  f/fo 


Quadrant  Separable  STRF 


w 


rising^requencies  as  it  did  to  falling  frequencies. 


The  STRF  is  not  separable, 
but  each  quadrant  of  the 
transfer  function  is,  i.e., 
there  are  different  spectral 
and  temporal  responses  for 
upwards  and  downwards 
frequency  modulation. 
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Singular  Value  Decomposition  (SVD) 

Evaluation  of  Separability 
Noise  Reduction 


Singular  Value  Decomposition  (SVD)  decomposes  the  matrix  into  a  sum 
of  separable  matrices,  ordered  by  their  overall  magnitudes.  The  first  k 
components  sum  to  a  matrix  which  minimizes  the  power  of  the 
remaining  components. 

We  apply  SVD  to  each  quadrant  of  the  transfer  function. 


Raw  STRF  estimate 


O 

o 

o 

a 


o 

liH 


0.25 


SVD  naturally  separates  the  signal  and 
noise  components  of  a  matrix.  Typically, 
large  jumps  in  the  singular  values 
indicate  where  the  separation  occurs. 
Noise  is  removed  by  discarding  the 
lower-magnitude  components. 


Without  prior  assumptions,  SVD  indicates  that  a  large 
majority  of  STRFs  in  AI  are  quadrant  separable. 
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X  (octaves) 


Predicting  Responses 

•  Predictions  of  Responses  to  Novel  Stimuli 


Good  test  of  linearity 


Stimuli  Used  for  Predictions 
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Predictions  and  Responses  ii 
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Non-Linearity— Predictions 


•  Preliminary  results  indieate  that  the  non-linear  predictions  fit  the  responses 
more  accurately  than  the  linear  predictions,  although  the  differences 
between  the  two  are  typically  subtle. 


8  Hz  Stimulus  linear  impulse  response 


0  t  (ms)  250  0  ( (ms)  250 


Response  and  Predictions 
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Response  and  Prediction  Spectra 
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spike  Rate 


Non-Linearity— Theory 


•  The  value  of  the  STRF  at  each  point  (x,  x)  is  the  slope  of  a  linear  rate- 

level  function:  ^(t)  =[STRF(t,  x)]  •  S(t-x,  x) . 

•  Polynomial  rate-level  curves  measured  at  every  (x,  x)  improve  the 
description.  These  are  potentially  non-linear  functions. 


Sj(t,  x)  R(t) 


Normalized  Stimulus  Level 


Measured  rate-level  function  at  x  and  x 

3rd  Order  Regression  Curve 

3rd  Order  Regression  with  Inverse-Repeat 

STRF  Estimate 

Mean  Spike  Rate 


•  Using  cubic  polynomials,  we  have  shown  that  either  the  non- 
linearities  are  absent,  or  they  are  dominantly  second  order. 

•  Subtraction  of  the  response  to  the  inverted  envelope  gives  a  nearly 
linear  polynomial  fit.  This  would  be  expected,  for  example,  from  a 
purely  even  order  (e.g.,  rectifying  non-linearity). 
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spike  Rate 


Spectro-Temporal  Rate-Level  Functions  ^ 


Rate-level  functions  change  with  T  and  v. 
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Summary 


•  The  function  of  AI 

To  encode  spectro-temporal  features  of  sounds 

spectrally:  up  to  ~  1  cycles/octave  (rarely  up  to  4  c/o) 
temporally:  ~  2  to  ~  20  Hz  (rarely  up  to  100  Hz) 

(in  ferret) 

plus,  of  course,  to  encode  other  sound  features  not 
addressed  here 


•  Spectro-Temporal  Response  Field  (STRF) 

•  Descriptor  of  spike  rate  for  broadband  dynamic  stimuli 

•  Predictor  of  spike  train  for  stimuli  of  dynamic, 

spectral  modulations  of  noise 

•  STRFs  agree  despite  measurement  method 

•  Predictions  of  responses  to  novel  stimuli 

•  Visual  Tool  demonstrates  spectro-temporal  regions  of 

excitation  and  inhibition 


•  Physiological  Constraints  (e.g.  Separahility)  constrain 
possible  network  dynamics 

•  Non-linear  corrections/generalizations 

realizable  and  work  in  progress 
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